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Abstract —Stochastic uncertainties in complex dynamical 
systems lead to variability of system states, which can in turn 
degrade the closed-loop performance. This paper presents a 
stochastic model predictive control approach for a class of 
nonlinear systems with unbounded stochastic uncertainties. The 
control approach aims to shape probability density function 
of the stochastic states, while satisfying input and joint state 
chance constraints. Closed-loop stability is ensured by designing 
a stability constraint in terms of a stochastic control Lya¬ 
punov function, which explicitly characterizes stability in a 
probabilistic sense. The Fokker-Planck equation is used for 
describing the dynamic evolution of the states’ probability 
density functions. Complete characterization of probability 
density functions using the Fokker-Planck equation allows 
for shaping the states’ density functions as well as direct 
computation of joint state chance constraints. The closed-loop 
performance of the stochastic control approach is demonstrated 
using a continuous stirred-tank reactor. 

I. Introduction 

The need to account for system uncertainties in model 
predictive control (MPC) of complex dynamical systems has 
led to extensive investigation of robust MPC approaches 
(e.g., see [1] and the references therein). The majority 
of work on robust MPC considers bounded, deterministic 
uncertainty descriptions with the goal to design MPC control 
laws that are robust to worst-case system uncertainties. The 
deterministic robust MPC approaches may, however, result in 
conservative closed-loop control performance, as worst-case 
system uncertainties are likely to have a small probability 
of occurrence [2], This consideration has recently motivated 
the development of stochastic MPC (SMPC) approaches 
that directly use probabilistic descriptions of the stochastic 
system uncertainties (i.e., parametric uncertainties, uncertain 
initial conditions, and exogenous disturbances). In particular, 
SMPC approaches allow for defining chance constraints in 
the stochastic optimal control problem to systematically seek 
tradeoffs between the control performance and robustness to 
system uncertainties. 

The formulation of a SMPC approach largely depends on 
the complexity of system dynamics, properties of stochastic 
uncertainties, and solution method for the stochastic pro¬ 
gramming problem. SMPC approaches have been proposed 
for linear systems with multiplicative noise [3], [4] and 
additive noise [5], [6], [7], [8]. The latter approaches mainly 
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use affine parameterizations of control inputs for finite- 
horizon linear quadratic problems to transform the stochastic 
programming problem into a deterministic one. Randomized 
algorithms have also been used to develop SMPC approaches 
for linear systems [9], [10]. Recently, a SMPC approach 
has been proposed for nonlinear systems with time-invariant 
probabilistic uncertainties using the generalized polynomial 
chaos framework [11] (also see [12] for SMPC for nonlinear 
systems in the absence of input constraints). Generally, the 
characteristics of stochastic uncertainties (e.g., boundedness, 
additive/multiplicative, and time-varying/time-invariant na¬ 
ture of stochastic uncertainties) have important implications 
for closed-loop stability and recursive feasibility properties 
of SMPC approaches with input constraints and chance 
constraints. In addition, the complexity of system dynamics 
largely affects the computational complexity of probabilistic 
uncertainty propagation (through system dynamics) as well 
as chance constraint handling. 

This paper presents a stochastic nonlinear MPC (SNMPC) 
approach for a class of nonlinear systems with probabilistic 
uncertain initial conditions and unbounded stochastic dis¬ 
turbances. The proposed SNMPC approach includes input 
constraints and joint state chance constraints. To ensure 
closed-loop stability of the SNMPC approach, a stochastic 
Lyapunov-based feedback control law that explicitly charac¬ 
terizes stability in a probabilistic sense is used (e.g., [13], 
[14]). The Lyapunov-based feedback control law allows for 
designing a stability constraint in terms of a stochastic con¬ 
trol Lyapunov function, which guarantees that the origin of 
the closed-loop system is asymptotically stable in probability 
(Section II). 

The Lyapunov-based SNMPC approach is intended to 
shape probability density functions (PDFs) of the stochastic 
state variables. This necessitates characterizing the complete 
PDFs of states. The Fokker-Planck equation [15] is used to 
describe the dynamic evolution of the (multivariate) PDFs as¬ 
sociated with the stochastic nonlinear system (Section III-A). 
Complete characterization of the states’ PDFs also allows for 
direct computation of joint state chance constraints without 
approximation. This work uses the Hellinger distance [16] to 
quantify the similarity between the predicted (multivariate) 
PDFs of states and user-specified reference PDFs for shaping 
the probability density functions (Section III-B). Note that 
control of PDFs of system states/outputs [17], [18], [19] 
and MPC of stochastic systems using the Fokker-Planck 
equation [20], [21] have been reported in the literature. 
What distinguishes this work is the generic formulation of 
the Lyapunov-based SNMPC approach in terms of PDF 



shaping as well as input and joint state chance constraints 
handling, while ensuring closed-loop stability (Section III- 
C). The presented Lyapunov-based SNMPC approach is 
demonstrated for stochastic optimal control of a continuous 
stirred-tank reactor in the presence of stochastic uncertainties 
(Section IV). 

II. Preliminaries 

Notation 

Throughout this paper, boldface symbols (e.g., x) denote 
vectors and subscripts denote vector elements (e.g., xi). 
R" denotes the n-dimensional Euclidean space with R + = 
[0, oo). The transpose of a vector or a matrix will be 
denoted by superscript T. Tr{ •} denotes the trace operator 
on a square matrix. For a vector x € R n , ||x|| denotes the 
Euclidean norm of x, and ||x||q denotes the weighted norm 
of x defined by ||x||q = x T Qx with Q being a positive 
definite symmetric matrix. P x denotes the (multivariate) 
probability density function of x 6 R". (Cl,F,V) denotes a 
probability space defined by the sample space Cl, er-algebra 
T, and probability measure V on Cl. Pr{-} denotes the 
probability of satisfaction of an expression. CfX denotes 
the Lie derivative of a scalar function X{-) with respect to 
a vector function f(-). A continuous function V : R” —> R 
is said to be C k if it is fc-times differentiable. A continuous 
function a : R + —»• R + is said to belong to class K, when it 
is strictly increasing and a(0) = 0. The function a is said to 
belong to class K,^ when a £ 1C and a(a) —> oo as a —► oo. 

System description 

Consider a class of stochastic nonlinear systems described 
by the stochastic differential equation (SDE) 

dx(t) = C(x(t))dt + g(x(f))u(£)dt + h(x(f))dw(f) 

x (fo) ~ Px 0 i 

(1) 

where x(f) £ R" denotes the stochastic state variables with 
the known initial multivariate PDF P Xo ; u(t) £ R m denotes 
the system inputs; w(f) denotes a g-dimensional standard 
Wiener process (i.e., stochastic disturbances) defined on the 
probability space (Cl,T,V)\ and f : R” —► R", g : R™ —> 
R" xm , and h : R" -A R” x? denote the Borel measurable 
functions that describe the system dynamics. The functions 
f, g, and h are assumed to be locally bounded and locally 
Lipschitz continuous in x(f), V£ £ R+, and f(0) = 0 
(i.e., the origin is the steady-state point of the unforced and 
undisturbed system). The latter conditions ensure uniqueness 
and local existence of solutions to the SDE (1) [22], The 
system inputs u(t) in (1) are constrained to lie in a nonempty 
convex set U C R m defined by 

U := {u (t) £ R m I U min < u(f) < U max }, (2) 

where u rntn £ R m and u max £ R m denote the lower and 
upper bounds on u, respectively. In addition, the stochastic 
system states x(f) should satisfy hard inequality constraints 

(3) 


where k : R n -A R p denotes (possibly) nonlinear functions 
that describe the state constraints, and k(0) = 0. 

Note that the stochasticity of system (1) arises from the 
probabilistic nature of uncertain initial states x(fo) (de¬ 
scribed by P Xo ) and the stochastic disturbances w. In (1), 
the terms f(x(f)) + g(x(f))u(f) and h(x(f)) correspond to 
the drift and diffusion terms in the Ito stochastic process , re¬ 
spectively [23]. Any general (deterministic) nonlinear model 
can be represented in terms of the control-affine deterministic 
drift term f(x(f)) + g(x(f))u(f) [24], 

Stochastic optimal control with state chance constraints 

This paper investigates stochastic MPC of the nonlinear 
system (1) such that stability of the closed-loop system is 
guaranteed. The proposed SNMPC approach should allow 
for shaping the multivariate PDF P X (f) of system states in 
an optimal manner, while the system inputs u(f) lie in the 
set U. In addition, the stochastic optimal control approach 
should ensure satisfaction of the (possibly nonlinear) state 
constraints (3) with at least probability /3 in the presence of 
system stochasticity. This requires incorporating joint chance 
constraints of the form 

Pr{k(x(f)) < 0} > (5 (4) 

into the stochastic optimal control problem. This paper 
considers receding-horizon implementation of the SNMPC 
approach in a full state feedback control scheme, where the 
PDF P x (tfc) is assumed to be known at every measurement 
sampling time instant tk- 

The key challenges that will be addressed in this paper 
for solving the above described stochastic optimal control 
problem are: (i) describing the dynamic evolution of the 
multivariate PDF P x (f) associated with the SDE (1), (ii) 
converting the joint chance constraint (4) to computationally 
tractable expressions, and (iii) designing the SNMPC control 
law such that it ensures closed-loop stability of the stochastic 
system. Next, the main result of stochastic Lyapunov stability 
(see [13], [25]) that will be used for designing a Lyapunov- 
based SNMPC approach is summarized. 

Lyapunov-based controllers 

For stochastic nonlinear systems, Lyapunov-based stabi¬ 
lizing control laws that explicitly characterize region of 
attraction of the closed-loop system in a probabilistic sense 
have been proposed (e.g., see [13], [26], [27], [14], and the 
references therein). In this paper, a Lyapunov-based control 
law is designed for the stochastic optimal control problem 
presented above. It is assumed that there exists a nonlinear 
feedback control law u(f) = p(x), Vx £ X C R", 
where p : R" -A R m denotes a nonlinear function and X 
denotes a compact set that contains the origin x = 0. The 
feedback control law p(x) is intended to make the closed- 
loop system asymptotically stable (in probability) about the 
origin, while the input and state constraints (i.e., (2) and (4)) 
are satisfied. According to the converse Lyapunov theorem 
[28], the existence of the feedback control law p(x) implies 


k(x(f)) < 0, 



the existence of a stochastic control Lyapunov function V (x) 
that is defined as in Thm. 1. 

Theorem 1 (Asymptotic stability in probability [13]): 

Consider the stochastic nonlinear system (1) and assume 
that there exists a C 2 -function V : R" —t R+, class /C Q0 
functions a\ and < 22 , and a class K, function < 23 , such that 
Vx e A, Vt > 0 

cti(|x|) < V(x) < a 2 (|x|), 

£ f V(x) +£ g V(x)u(f)| u(t)=p{x) + 

I -r-/) 2 V 

-Tr{h(x) T -^-h(x)} < a 3 (|x|). 

Then the stochastic control Lyapunov function V (x) ensures 
that the origin is asymptotically stable in probability. ■ 
Thm. 1 indicates that the stochastic Lyapunov-based con¬ 
trol techniques allow for defining feedback control laws that 
will lead to 

1 _ t) 2 V 

£ f V(x) + £ g V(x)u(i)| u(t)=p{x) + -Tr{h(x) T ^-h(x)} 
+ yV(x) <0, Vx G II, 

(5) 

where the set II is defined by 

II := sup {x e R n | u € D, x € X, V(x) < c}; 

ceR 

and 7 > 0 is a constant. Next, the stochastic control 
Lyapunov function V(x) will be used for designing a control 
law for the stochastic optimal control problem such that 
closed-loop stability of the proposed SNMPC approach is 
guaranteed. 

III. Stochastic Nonlinear Model 
Predictive Control 


The FP equation associated with the SDE (1) that describes 
the evolution of the multivariate PDF P x (f) is defined by 



with the initial condition 

P*(0) = Px 0 , 

where D = h(x)h(x) T (i.e., the diffusion matrix). The FP 
equation ( 6 ) is a parabolic partial differential equation, whose 
solution should be nonnegative and satisfy 



P x (f)dx = 1, 


\/t > 0 . 


The existence and uniqueness of a solution to ( 6 ) under 
mild assumptions have been established (see [15], [29]). 
Note that the FP equation ( 6 ) can be used to compute the 
univariate PDFs P Xi for every state x, and joint PDFs for 
any combination of stochastic states. 

Solving the FP equation is generally challenging for 
nonlinear systems, in particular systems with high state 
dimension [15]. Various numerical methods such as finite dif¬ 
ference and finite element methods have been used to solve 
the FP equation for nonlinear systems (e.g., see [30] and the 
references therein). In this work, finite volume method with 
first order upwind interpolation scheme is used to solve ( 6 ) 
[31]. The finite volume method allows for effectively dealing 
with the convective nature of the FP equation (due to the drift 
term), as well as suppressing numerical instability problems. 


This section presents the formulation of the Lyapunov- 
based SNMPC approach with joint state chance constraints. 
The propagation of probabilistic system uncertainties (i.e., 
uncertain initial states and stochastic disturbances) through 
system dynamics is described by the Fokker-Planck equation. 
The Hettinger distance is used as a measure of similarity of 
multivariate PDFs to formulate the objective function of the 
stochastic optimal control problem for PDF shaping. 

A. Fokker-Planck Equation for Uncertainty Propagation 

The Fokker-Planck (FP) equation describes the dynamic 
evolution of the PDF of stochastic states x(t) in the uncertain 
nonlinear system (1) [15], The FP equation readily char¬ 
acterizes the complete multivariate PDF P x (i) arisen from 
the stochastic system uncertainties in initial states x(f 0 ) and 
disturbances w. This is in contrast to uncertainty propagation 
techniques that describe merely certain statistics of the PDFs 
(e.g., see [11] and the references therein). Characterizing the 
complete PDF of states using the FP equation enables the 
proposed SNMPC approach to: (i) shape the PDF P x with 
respect to any desired (multivariate) PDF, and (ii) compute 
chance constraints of any complexity directly without con¬ 
servative approximations. 


B. Metric for Similarity of Probability Density Functions 

The SNMPC approach aims to shape the PDF P x ac¬ 
cording to a predetermined (arbitrarily-shaped) PDF. Hence, 
a metric is required to quantify the similarity between the 
predicted and the reference PDFs at each time instant t. 

This paper uses the Bhattacharyya coefficient [32], a 
measure closely related to the Bayes error [33], to establish 
a measure for the similarity of PDFs. The Bhattacharyya 
coefficient quantifies the degree of overlap between two 
(multivariate) PDFs, and is defined by 

®(x) := J V /Px(i)P? f dx, (7) 

where P™ f denotes a reference PDF. The Bhattacharyya 
coefficient will be larger when the overlap between the PDFs 
is larger. 93 (x) = 0 if the PDFs do not overlap, whereas 
93(x) = 1 when the PDFs are identical. Explicit forms of 
the Bhattacharyya coefficient for various PDFs are given in 
[32], [34], 

The Bhattacharyya coefficient (7) is used to define a metric 
for the similarity between P x (t) and P™ f in the objective 
function of the stochastic optimal control problem. The 



metric, which is known as the Hellinger distance [16], is 


defined by 


A(x) := v/l-®(x). 


Note that the metric (8) is near optimal due to its relation to 
the Bayes error, and can be used for arbitrary PDFs [35]. 


C. Formulation of the Lyapunov-based SNMPC Approach 

The Fokker-Planck equation (6) and the Hellinger dis¬ 
tance (8) are now used to formulate the Lyapunov-based 
SNMPC problem for the stochastic nonlinear system (1). 

Problem 1 (Lyapunov-based SNMPC with input and 
joint state chance constraints): Suppose that the PDF 
Px(tfe) is known at every sampling time instant The 
stochastic optimal control problem at each time instant tk is 
stated as 

u*(Px(4)) := argmin J (x(t')) + ||u(f')||R ^ dt' 


the FP equation for probabilistic uncertainty propagation, 
as the FP equation enables explicit characterization of the 
states’ PDFs. The objective function in (9) is stated in its 
most general form in terms of the Hellinger distance to 
quantify the difference between the multivariate PDFs P x (f) 
and P^ ef over the prediction horizon t G [0, T p ]. 2 The 
objective function can be simplified by considering only 
certain statistics (e.g., the expected value and variance) of 
the PDFs. Furthermore, the joint state chance constraint 
in (9) can be readily computed through explicit integration 
without any approximation since the knowledge of the full 
multivariate PDF is available. When merely individual state 
chance constraints are considered in (9), the FP equation 
can be adapted to compute only the univariate PDFs for 
the respective states. This will reduce the computational 
complexity of the stochastic optimal control problem. Next, 
the application of the Lyapunov-based SNMPC approach to 
a continuous stirred-tank reactor is investigated. 


s ' l ' : 


dt ' dxi 

i =1 
n n 


2 ^ ^ dxidxj 

1=1 J — l J 


dxMi l Aj(5c)Px J “ °’ 


£ f V (x) + £gV (x)u(i)+ 
iTr{h(x) T 0h(x)}+ 7 V(x)<O, 


IV. Case Study: Stochastic Optimal Control of a 
Continuous Stirred-Tank Reactor 

Consider a continuous stirred-tank reactor (CSTR), in 

/c 

Vf € [0, T p \ which the exothermic reaction A —> B occurs. The system 
dynamics are described by 


Vi € [0, T p ] 


dC A = (y{CA0 - C A ) - k 0 e^C A ^j dt 

+ ac A dw CA (t ), Ca(0 ) ~ B( 0 , 2 ,320,320) 


Pr{k(x(f)) < 0} > /3, Vf G [0, T p ] 

u (t) G U, Vi G [0, T c ] 

P*(0) = Px(ffc), 

(9) 

where u* denotes the optimal inputs (i.e., control policy) 
over the control horizon [0, T c ]; x denotes the states 
predicted by the system model; T p denotes the prediction 
horizon; and R denotes a strictly positive definite matrix. The 
closed-loop stability of the SNMPC approach is ensured in 
a probabilistic sense by incorporating the stability constraint 
(defined in terms of the stochastic control Lyapunov function 
V(x)) into (9). The asymptotic stability properties of the 
closed-loop system are characterized in Thm. 1 and (5). The 
proposed stochastic control approach possesses the stability 
properties of Lyapunov-based controllers when applied in 
a sample-and-hold fashion (e.g., see [14]). Note that the 
stochastic optimal control problem (9) is implemented in 
a receding-horizon mode, where merely the optimal inputs 
u*(0) are applied to the stochastic nonlinear system (1) at 
every sampling time instant tk- 

The Lyapunov-based SNMPC approach in Problem 1 
allows for shaping the multivariate PDF of states, while 
satisfying input constraints and joint chance constraints 
imposed on the stochastic states. This is due to using 

1 Note that this work considers a full state feedback control scheme. The 
PDFs Px(ifc) arise from measurement errors. 


dT =( ^(T 0 - T) + —k 0 e^C A + -%)dt, 

VC pc p pc p V) 

T{ 0) = 315.0, 

where C A denotes the concentration of species A (kmol/m 3 ); 
T denotes the reactor temperature (K); C A o (with the mean 
value of 0.702 kmol/m 3 ) and To denote the concentration of 
species A and the temperature in the inlet reactor stream, re¬ 
spectively; F denotes the inlet flow rate (m 3 /min); V denotes 
the reactor volume (m 3 ); B denotes the four-parameter beta 
distribution; Q denotes the heat removed from the reactor 
(kJ/min); and wc A {t) denotes a standard Wiener process 
acting on C A . The model parameters are listed in Table I. 
Note that the CSTR under study is a stochastic system due 
to the probabilistic uncertainties in the initial concentration 
C A (0), as well as the stochastic disturbances wc A (f). The 
system inputs that can be manipulated for control are C A q 
and Q. It is assumed that the temperature T and the PDF 
of C A (which is of beta-distribution type) are measured at 
every sampling time instant tk (i.e., 2 min). The process is 
run for 30 min. 

The Lyapunov-based SNMPC approach presented in Prob¬ 
lem 1 is applied to stabilize the CSTR around the steady- 
state point (C A = 0.57 kmol/m 3 , T = 317 K), while shaping 
the probability density of C A to take the form of the Normal 

2 When the control objective is to achieve desired PDFs for individual 
states, the objective function in (9) can be defined in terms of weighted 
sum of Hellinger distances pertaining to the univariate PDF of states. 



TABLE I 

CSTR MODEL PARAMETERS. 


V 

0.1 ra 3 

SH 

4.78 x 10 5 kJ/kmol 

F 

100 X 10 -3 m 3 /min 

ko 

72 X 10 9 min" 1 

To 

315.0 K 

Cp 

0.239 kJ/kgK 

E 

8.314 x 10 4 kJ/kmol 

p 

1000 kg/m 3 

R 

8.314 kJ/kmol K 

a c A 

0.32 


Distribution A/"(CU,4x 1CT 4 ) (i.e., P£? = U(C a Ax 10" 4 ) 
in (7)). The objective function in (9) is defined as 

J P ^A(C A (t , )) + \\E[T(t')}-f\\ 2 ^jdt , : (10) 


where E[-] denotes the expected value. The prediction hori¬ 
zon and the control horizon are selected to be T p = 30 
min and T c = 20 min, respectively. Note that the objective 
function (9) is defined such that the SNMPC approach 
minimizes the difference between the PDF of Ca and the 
reference PDF PJ.’ cr over the prediction horizon [0, T p \. To 
design the stability constraint in (9), the quadratic Lyapunov 
function V(x) is defined as V(x) = x T Px, where x = 


[C A -C a T- T] t and P 


3.18 0.93 
0.93 0.58 


. The matrix 


P is obtained by solving the Lyapunov equation for the 
(nominal) linearized system dynamics around the steady- 
state point. 

In the stochastic optimal control problem (9), the inputs 
to the system are constrained to lie in the ranges 0 < 
Cao < 2 kmol/m 3 and \Q\ < 10 kJ/min. In addition, the 
concentration Ca should remain above a threshold in the 
presence of probabilistic system uncertainties. Hence, the 
individual chance constraint 


Pr{C A (t) < 0.53} < 0.05 (11) 

is incorporated into (9), suggesting that the state constraint 
C A (f) < 0.53 should be satisfied with at least probability 
95% in a stochastic setting. Since the individual chance 
constraint and the univariate PDF shaping in the objective 
function have been defined merely in terms of the con¬ 
centration Ca, the FP equation (6) is considered only for 


& 30 

c 

d) 



Fig. 1. Histograms of the concentration Ca at various times based on 130 
closed-loop simulations with different disturbance realizations wc A - The 
SNMPC approach is intended to shape the probability distribution of Ca in 
the course of the process according to the reference probability distribution 
(red solid distribution). 



Time (min) 


Fig. 2. Probability of state constraint violation at various times during the 
process. The probability of state constraint violation always remains below 
5% (red solid line) due to the state chance constraint (11). 


Ca with the diffusion coefficient D = 0.001. The FP 
equation is solved using the finite volume method with 200 
discretization points over the concentration support [0, 2]. 
The above constrained nonlinear optimal control problem is 
solved using the MATLAB subroutine fmincon, where the 
set of model equations is integrated using the solver ODE45. 
The control inputs are discretized in a piecewise constant 
fashion in 5 intervals over the control horizon. 

To evaluate the performance of the SNMPC approach, 
Monte Carlo simulations of the closed-loop system are 
performed based on 130 realizations of the Wiener process 
vjc a (the disturbance realizations are used for simulating 
the CSTR model to which the optimal control inputs are 
applied at every sampling time instant t *.). Fig. 1 shows the 
evolution of the probability distribution of the concentration 
C A (i.e., true plant outputs) in the course of the process. 
The SNMPC approach stabilizes the stochastic CSTR system 
around the steady-state point Ca = 0.57 kmol/m 3 ; the CSTR 
temperature is also stabilized around its steady-state value 
T = 317 K (not shown here). In addition. Fig. 1 shows 
that the SNMPC approach can effectively shape the PDFs 
of Ca according to the reference PDF PJ/f . For instance, 
the mean and variance of the PDF of Ca at time 30 min 
are 0.576 and 4.3 x 10 -4 , respectively, which are aligned 
with those of the reference PDF = A7(0.57,4 x 10 -4 ). 
The probability of violation of the state constraint over the 
process time is shown in Fig. 2. The probability of constraint 
violation remains below the predetermined probability level 
5% (i.e., /3 = 0.05 in (11)) at all times during the process. 
Effective constraint handling is due to the state chance 
constraint (11), which ensures constraint satisfaction with 
a desired probability level in the presence of stochastic 
uncertainties. Note that simulation results (not shown here) 
revealed that by decreasing the desired probability of chance 
constraint satisfaction, the closed-loop control performance 
in terms of the PDF shaping can be further improved. This 
indicates the capability of the SNMPC approach to system¬ 
atically seek tradeoffs between the closed-loop performance 
and robustness to system stochasticities. 

V. Conclusions 

A stochastic model predictive control approach is pre¬ 
sented for a class of nonlinear systems with stochastic un- 











certainties. The closed-loop stability of the control approach 
is ensured by explicitly characterizing stability in a proba¬ 
bilistic sense using a stochastic control Lyapunov function. 
A key challenge in SMPC is efficient propagation of uncer¬ 
tainties through the system dynamics to fully characterize 
the probability distribution of the stochastic states. This paper 
uses the Fokker-Planck equation for uncertainty propagation, 
which allows for describing evolution of the probability 
distributions of the stochastic states for general probabilistic 
uncertainty descriptions. This work demonstrates that char¬ 
acterization of the complete probability distribution enables 
shaping the states’ probability distributions with respect to 
arbitrarily-shaped reference distributions, as well as direct 
computation of chance constraints without any approxima¬ 
tion. 
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